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Abstract 

We study multivariate approximation defined over tensor product Hilbert spaces. 

The domain space is a weighted tensor product Hilbert space with exponential 
weights which depend on two sequences a = {aj}jeN and b = (C'h'eN of positive 
numbers, and on a bounded sequence of positive integers m = {mjH'eN- The 
sequence a is non-decreasing and the sequence b is bounded from below by a positive 
number. We find necessary and sufficient conditions on a, b and m to achieve the 
standard and new notions of tractability in the worst case setting. 
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Weights 
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1 Introduction 

We approximate s-variate problems by algorithms that use finitely many linear func¬ 
tionals. The information complexity n(e, s ) is defined as the minimal number of linear 
functionals which are needed to End an approximation to within an error threshold e. 

The standard notions of tractability deal with the characterization of s-variate prob¬ 
lems for which the information complexity n(e, s ) is not exponential in and s. Since 
there are many different ways of measuring the lack of the exponential dependence we 
have various notions of tractability. For instance, weak tractability (WT) means that 
log n(e, s)/(s + £ -1 ) goes to zero as s + e -1 approaches infinity, whereas quasi-polynomial 
tractability (QPT) means that n(e,s) can be bounded for all s G N and all e e (0,1] by 
C exp(t (1 + log s)(l + log £ -1 )) for some C and t independent of both e" 1 and s. Anal¬ 
ogously, we have polynomial tractability (PT) if n(e, s ) can be bounded by a polynomial 
in e" 1 and s, and strong polynomial tractability (SPT) if n(e, s ) can be bounded by a 
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polynomial in e^ 1 for all s. These notions of tractability have been extensively studied in 
many papers and the current state of the art in this field can be found in [121 IS; 33] • 

The notion of WT was recently refined in [L8J by introducing (fy, f 2 )-weak tractability 
((ti, t 2 )-WT) by assuming that log n(e, s )/(s* 1 + e ~ l2 ) goes to zero as s + e approaches 
infinity for some positive t\ and t 2 . Uniform weak tractability (UWT) was defined in [[17] 
by assuming that (U,t 2 )-WT holds for all ti,t 2 £ (0,1]. It is easy to check that for 
t\,t 2 £ (0,1] we have the following hierarchy 

SPT ^ PT =y QPT =y UWT =y (ti,t 2 )-WT => WT. 

All these standard notions are appropriate for s -variate problems for which the minimal 
errors are polynomially decaying. That is, for any n £ N we can find n linear functionals 
and an algorithm using these n linear functionals whose error decays like 0{n~ p ) for some 
positive p and with the factor in the big O notation that may depend on s. 

There is a stream of work with new notions of tractability which is relevant for s -variate 
problems for which the minimal errors are exponentially decaying, see pei ei mum is]. 
The new notions of tractability correspond to the standard notions of tractability but for 
the pair (s, 1 + log £ _1 ) instead of the pair (s, e -1 ). For instance the new notion of strong 
polynomial tractability means that we can bound n(e, s) by a polynomial in 1 + log e^ 1 
for all s £ Id. Obviously, the new notions of tractability are more demanding than the 
standard ones. To distinguish them from the standard notions we add the prefix EC 
(exponential convergence) and we have EC-WT, EC-UWT, EC-(U, t 2 )-WT, EC-QPT, 
EC-PT, and EC-SPT. For t\,t 2 £ (0,1], we obviously have 

EC-SPT => EC-PT =*► EC-QPT => EC-UWT => EC-(U,f 2 )-WT => EC-WT. 

We study (£i,£ 2 )-WT and EC-(U, i 2 )-WT for general positive t\ and t 2 , i.e., dropping 
the assumption that they are from (0,1]. Obviously, if t\ > 1 we do not have an exponen¬ 
tial dependence on but we may have the exponential dependence on s T for r <t\. For 
r = 1, we may have an exponential dependence on s which is usually called the curse of 
of dimensionality. Nevertheless, the parameters t\ and t 2 control the level of exponential 
behaviour with respect to s and e _1 , and it seems to be an interesting problem to find 
the minimal, say, t\ for which we have (ti,t 2 )-WT or EC-(£i, i 2 )-WT. 

In this paper we study all these standard and new notions of tractability. This is done 
for general multivariate approximation defined over tensor product Hilbert spaces in the 
worst case setting. The construction of our problem is roughly as follows. For s = 1, we 
take a separable Hilbert space H of infinite dimension with an orthonormal basis {efc}fcgN 0 ; 
where N 0 = {0,1, 2,...}, and inner product (■, •)#. In general, we do not assume that H 
is a space of functions or that it is a reproducing kernel Hilbert space. Therefore we can 
only consider linear functionals as information used by algorithms. 

From the space H, we construct a weighted Hilbert space in the following way. For 
given positive numbers a, b, uj with uj £ (0,1), and a bounded sequence m = {mk}km 0 °f 
positive integers, the Hilbert space H a b is a subspace of H for which / £ H a b iff 

( mo —1 oo m/,. — 1 

I" + J2 U ~ akb \(f^mo+-+m k -i+,) H \ 2 

j =0 k =1 j =0 

Note that co~ akb goes exponentially fast to infinity with k. Therefore, ||/||# a6 < oo means 
that the sum of | (/, e mo+ ... +mA ,_ 1+ j) | 2 for j — 0,1,..., m k — 1 must decay exponentially 

fast with k. 
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The univariate approximation problem APPi : H ab —>■ II is defined as the embedding 
operator APPi/ = /. The s-variate approximation problem 

S 

API’, ®// 

3 = 1 

is the embedding operator APP S / = /, where 

H St a,b ■ $5 H a2 fo $5 ■ ■ ■ $5 H as i )g 

is the s-fold tensor product of the weighted spaces H ajt b r Here a = {aj}j e ^ and b = 
{ bj}j & n- We assume that cq > 0, the a 3 'a are nondecreasing, and inf ? b 3 > 0. 

The space H s a b is a subset of //, with exponentially decaying coefficients in the basis 
of H s . The speed of the decay depends on the parameters a , b. m and c o of the problem. 

Special instances of the spaces H sab are weighted Hermite and Korobov spaces which 
were already analyzed in the papers mentioned before. In fact, similarity in the analysis 
of weighted Hermite and Korobov spaces was an indication that more general weighted 
spaces can be also analyzed and it was the beginning of this paper. Other special instances 
of H sab are £ 2 , cosine and Walsh spaces which have not been analyzed in this context 
before. 

The weighted Hermite and Korobov spaces consist of analytic functions. This property 
is not shared, in general, for spaces H sab . As for the univariate case, the space H sab 
does not have to be a space of functions. But even if we assume that H s a b is a space of 
functions then the functions e*, do not have to be analytic or even smooth (for example 
this is the case for the Walsh space). It turns out that analyticity or smoothness of the 
functions e*, is irrelevant. Instead, the exponential decay of the coefficients in the basis of 
H s is important. That is why the results for the space H s ab are similar to the results for 
the weighted Hermite and Korobov spaces. 

We now briefly summarize the main results obtained in this paper. We first study when 
exponential convergence (EXP) and uniform exponential convergence (UEXP) hold. EXP 
holds if there is q G (0,1) such that for all sSNwe can find positive C S) M s ,p s for which 
the nth minimal worst case error for approximating APP S , see Section [3J. is bounded by 

C s q {n/Ms)Ps for all n G N. 

The supremum of such p s is called the exponent of EXP and denoted by p*. UEXP holds 
if we can take p s = p > 0 for all s G N, and the supremum of such p is called the exponent 
of UEXP and denoted by p*. 

We prove that EXP holds always with no extra conditions on the parameters a , 6, m, u ;, 
and p* = 1 /Ylj=i bj 1 , whereas UEXP holds iff B := bj 1 < 00 and then p* = l/B. 
Hence, UEXP only requires that 6J 1 ’s are summable and there are no extra conditions 
on the rest of the parameters. 

We now turn to tractability. We obtain necessary and sufficient conditions on standard 
and new notions of tractability in terms of the parameters a, b , m and c 0 of the problems. 
Such conditions were not known before even for weighted Hermite or Korobov spaces. 
More precisely, UWT, QPT, EC-UWT, EC-QPT as well as (f b i 2 )-WT and EC-(U,t 2 )- 
WT were not studied before for the weighted Korobov spaces, and approximation has not 
been studied at all for Hermite spaces before. 
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To stress that we approximate APP S , we denote the information complexity n(e, s ) by 
n(e, APP S ), see again Section [3j In this paper we present specific lower and upper bounds 
on n(e, APP S ) from which we conclude various notions of standard and new tractability. 
We also present estimates of the tractability exponents. They are defined as the infimum 
of t for QPT and EC-QPT, or the infimum of the degree of polynomials in e 1 for SPT 
and in 1 + log e -1 for EC-SPT which bound the information complexity n(e, APPQ. We 
usually do not have the exact values of these exponents but only lower and upper bounds. 
It would be of interest to improve these bounds. In this section, we only mention when 
various tractability notions hold. We prove: 

• (U, f 2 )-WT holds for the parameters a, 6, m and oj iff t\ > 1 or m 0 = 1. 

• EC-(£i, t 2 )-WT holds for the parameters a, 6, m and oj iff t x > 1, 
or t 2 > 1 and uiq = 1. 

• WT holds iff m 0 = 1, whereas EC-WT holds iff 

mo = 1 and lim aj = oo. 

j-too 


UWT holds iff m Q — 1, whereas EC-UWT holds iff 


mo = 1 and lim 


log a,- 


3-too log j 

QPT holds iff m 0 = 1, whereas EC-QPT holds iff 

.r 1 


= OO. 


m 0 = 1, sup 

seN 1 + log s 


3=^3 ( 1 + 1 °g j) lo & a l 


< oo, and lim inf 

j-*0 o 


> 0. 


PT holds iff SPT holds iffl 


mo = 1 and lim 


j->oo log j 


> 0 . 


• EC-PT holds iff EC-SPT holds iff 


m 0 = 1, 


OO 




< OO, 


and 


. , log Clj 
Inn mf J > 0. 

j-> oo j 


We would like to mention that the results for EC-UWT and EC-QPT for one particular 
example of H s a>b (of Korobov type - see Example [S]) were independently shown by Guiqiao 
Xu (private communication). 

Observe that for m 0 > 1, only (ti,f 2 )-WT and EC-(ti,f 2 )-WT with t\ > 1 hold. The 
reason is that 

n(e, APP S ) > m S Q for all e E (0,1), 

and we have the curse of dimensionality. This also shows that the condition t\ > 1 is 
sharp. So we have to assume that mo = 1 to obtain other notions of tractability in terms 

1 Under a simplifying assumption that the limit of cq / log j exists. 
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of the conditions on a and b. Interestingly enough there are no conditions on rri k for 
k > 0 and on oo. However, the exponents of tractability as well as constants depend on 
m k for k > 0 and on oo. We illustrate the necessary and sufficient conditions on various 
notions of tractability for m 0 = 1 and for 

Qj = j vi exp (v 2 j) and bj = j V3 for j > 1 

for some non-negative iq,i ; 2 and u 3 . Then 

• EXP, (fi,t 2 )-WT, EC-(ti, t 2 )-WT with t\ > 1, WT and QPT hold for all vi,V 2 ,V 3 , 

• UEXP holds iff 7-3 > 1, 

• EC-WT, PT and SPT hold iff v\ + v\ > 0, 

• EC-PT and EC-SPT hold iff v 2 > 0 and V 3 > 1. 

The remaining sections of this paper are structured in the following way. We provide 
detailed information on the Hilbert spaces which are studied in the paper in Section [2l We 
outline the setting of the approximation problem in Section [3] The results on exponential 
and uniform exponential convergence are shown in Section In Section 0 we prove the 
results on the various notions of tractability. A table which summarizes all conditions is 
presented in Section [ 6 j 

2 Weighted Hilbert Spaces 

Let H be a separable Hilbert space over the real or complex field. To omit special cases, 
we also assume that H has infinite dimension. Let be its orthonormal basis, 

(e k , ej) H = 5k j for all k,j G No- Hence, for f E H one has 

OO OO 

f = ^(f,e k ) H e k with | (/, e k ) H | 2 < 00 . 

k =0 k =0 

For s £ N := {1, 2,... }, by H s = H ® H <S) ■ ■ ■ <g) H we mean the s-fold tensor product 
of H. For k = [fci, fc 2 ,..., k s ] G Mg, let e k = e kl 0 e k2 <g> • • • ® e ks . Clearly, {e k }keN s 0 is an 
orthonormal basis of H s and for / G H s one has 

/ = (/, e k ) Ha e fc with I (/> e k) Ha I 2 < °°- 

fceNg fee Ng 

We now define a weighted Hilbert space which will depend on a number of parameters. 
Some of these parameters will be fixed while others will be varying. The fixed parameters 
are: a number 00 G (0,1) and a bounded sequence m = {m fc } fceNo of positive integers. 
With the sequence m we associate a sequence r = {r k } k£ ^ 0 given by 

A) = 0, 

r k = m 0 + mi + ■■■ + m k -1 for all k G M. 
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Clearly, r k+ \ = r k + mk > r k + 1. Furthermore, 

OO 

No = U {Ac, r-fc + 1,..., r fc+1 - 1} 


k =0 


and the sets {r k , r k + 1,..., r fc+1 — 1} are disjoint. 

The varying parameters are positive real numbers a and b. The weighted Hilbert space 
will be therefore denoted by H ab and is defined as 


H a , b =UeH : 


H n h ■ — 


,fc=0 J=r k 

As an example, consider m k = 1. Then r k = k and 


oo r k+ i — l \ F- 

Y^ Y I (f ’ 6 j)H | 2 ) < OO i. 


H n .. h • — 




1/2 


K k=0 


For a general m, note that u akb goes exponentially fast to infinity with k. Therefore 
H ab < oo means that Y^/=r k I (/; e i)jr 1 2 must decay exponentially fast to zero as k 


goes to infinity. 

The inner product in H a b is given for /, g G b by 


OO Ffc_|_i — 1 

Ub 


Ui9)H ab = Y U akb Y e ^H (di e j) 


H' 


k =0 


]=rk 


Since u ak > 1, we have 


h < \\f\\H aib for all / G H a , h . 


( 1 ) 


We now find an orthonormal basis {e niQi b} ne N 0 of H a)b . For n G No, there is a unique 
k = k(n ) such that n G {r k ( n ), fk{n) + 1,..., r k ^ n )+i — 1}- Then we set 

e _ a[k(n )] b /2 

c n,a,o u/ G n- 

We now verify that the sequence {e niaj b} ne N 0 is orthonormal in H a b . Indeed, take 
ni,n 2 G N 0 . Then 


ni,a,bi ('n, 2 ,a,b) 


oo i'k +1 — 1 

E ""* 1 E (&n\,a,bi &j) ft (firi 2 ,a,bi&j) 

k =0 /=r fe 

OO 0: + l“l 


H 


E 

/c=0 


o; 


—a/c b +a[fc(ni)] 6 / 2 +a[fc(n 2)] b /2 


^ 1 ( e ni) e /)ir { e n2i e j) 


H- 


J=rk 


Suppose that ni ^ n 2 . Then the last sum over j is zero for all k G No due to the 
orthonormality of . Suppose now that n\ = n 2 . Then the only non-zero term 

is for k = k(ni) and j = so that the sum is 1. Hence, (e nii£li &, e n2)(lyb ) H = 5 nitn2 . 
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Finally, note that H a)b C H — span(ei, e 2 ,...) = span(ei jat b, C 2 , a ,b, ■ ■ ■), which means that 
{e n ,a,fe}neNo is an orthonormal basis of H a ^, as claimed. 

The norm in H atb can now also be written as 


1/2 


H nh — 


^ ^ I (/'i e n,a,b) H a 


in=0 


We remark that k{ri) = 0 for n G {0,1,..., m 0 — 1} and therefore, e n ^ ib = e n and 
\\e n ,a,b\\H a}b = ||e „|| H = 1 for all n G {0,1,..., m 0 - 1}. 

The last equality holds for m 0 elements, and m 0 > 1. This and (jT]) imply 


sup 


H 


= 1 . 


( 2 ) 


II 


Similarly as for the space H s , we take the s-fold tensor products of the weighted 
space H ajjbj with possibly different dj and bj such that 


0 < a\ < do < • • • and inf 6 , > 0 . 

je n J 


(3) 


That is, 


H s ,a,b H aibl H a2 $5 ■ ■ ■ $5 H ag ,b s 

For n = [m, n 2 , • ■ •, n s ] G Ng, dehne 


&n,a,b Cni,ai, 6 i ® 6712 , 02,62 


e n s ,a a ,b a ■ 


Then is an orthonormal basis of H sab and / G H sab iff 


f Y, (/) en ' a -b) H a . a , b e n,a,b with ||/lk,a,& • ( } ] I (/) e n,a,b) a b 


1/2 


< OO. 


n G Ng 


. n£Ng 


We now show that 

||/lk < ||/lk lBlb for all / G H sab . (4) 

Indeed, for / G H s ^ b we have / = EneNg a n e n,a,b with \\f\\ 2 Ha a b = En GN g \ a ™\ 2 < oo. 
For any rtj G N 0 there is a unique k(rij ) G N 0 such that rij G {rk( nj ), r k(n j ) + 1, • • •, ^k( nj )+ 1 ~ 
1}, and e n . a . bj = u a ^ k{ - n ^°e n .. Therefore 


,aj[k(nj)] b 3 /2 


e n ,a.b= I n —- 1 e »- 


( 5 ) 


\j =i 


We have / = En G Ng (iILi uJ ajlk(nj)]bj/2 ^j e n and 


1/2 / \ 1/2 

H s = ( y \a n \ 2 Y[u a ^ n ^ 0j I < ( y | aj 2 
n eNg 3=1 J \n G Ng 


- J \ H, 
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as claimed. 

For n G {0,1,..., mo — 1} S , we have k(rij ) = 0 for j — 1, 2,. .., s. Therefore e n ^ a ,b = 
and 

\\e n , a ,b\\H s ^ b = \\e n \\ Hs = 1 for all n G {0,1,..., m 0 - 1} S . 

The last equality holds for m^ elements. This and (J4J) imply 


sup ||/||m = 1. 


( 6 ) 


Note that (J3J) implies that {e n } ne Ng is orthogonal in H sab and 

S 

\\e n \\ Hs , a , b = for all n G Ng. 

3 = 1 


For f E H s we have / = E™ G Ng (/> e ™ with E™eNg I (/> e ^) Hs I 2 < °o. Such / 
belongs to H s ^ ab iff 


1/2 


Ha _n. .h 


e n 

,™eNg j =i 


cu 


-Oj[fc(n 3 -)] i I 


(/, e n ) 




< OO. 


As for the univariate case, we see that JR =1 (jj~ a AK n i)\ 3 goes exponentially fast to in¬ 
finity if one of the components of n goes to infinity. Therefore | (/, e n ) H | must decay 
exponentially fast to zero if one of the components of n approaches infinity. 


Remark 1. 


We stress that the spaces H , H s and H s a b do not have to be reproducing kernel 
Hilbert spaces, see [Tj for general facts on reproducing kernel Hilbert spaces. Indeed, the 
initial space H does not have to be a function space. But if II is a Hilbert space of real 
or complex valued functions defined on, say, a common domain D, then it is well known 
that H is a reproducing kernel Hilbert space iff 

OO 

\ek(x)\ 2 < oo for all x G D. (7) 

k =0 


If (0) holds then 


OO 

K(x, y) = ^ e k (x) e k (y) for all x,y G D 

k =0 


is well-defined for all x,y G D, because 


\K(x,y)\ 


J ^e k {x)e k (y ) 


k =0 


< 


y^|e fc (x)|' J > ] \e k (y) | s 


1/2 


< oo 


,k =0 


k =0 


by the Cauchy-Schwarz inequality. Moreover, 


( 8 ) 


f(y) = (f, K (-,y)) H for all / G H and y G D. 






holds and so (JHJ) is a reproducing kernel of H. If (J7]) holds then //, is also a reproducing 
kernel Hilbert space and its kernel is 

S 

K s (x , y) = K(xj, yj) = 22 e k (x) e k (y) for all x, y G D s . 
j =i feeNg 

Similarly, the weighted space H a b is a reproducing kernel Hilbert space iff 

oo r k+ i — l 

22 u o ak 22 |ej(x )| 2 < oo for all x G D. (9) 

k =0 j=r k 

Clearly, the condition (JDJ) is weaker than the condition (JTJ). Hence, it may happen that 
H is not a reproducing kernel Hilbert space but H ab is. We shall see examples of such 
spaces in a moment. 

If (jnj) holds then the reproducing kernel of H a ^ is 

OO OO r k+l~ 1 

Ka,b{x,y) = ^e k ^ b (x)e k ^ b (y) = 22^ 22 e j (x)e j (y) for all x,y G D. 

k =0 fc=0 j=i'k 

If (J9]) holds then H s a b is also a reproducing kernel Hilbert space and its kernel is 


K Si a ib (x, y) = JJ Ka.fi.ixj, Uj) = 22 e k,a,b{x) e kta>b (y) for all x, y G D s . 
j =1 fceNg 

We illustrate the weighted Hilbert spaces H s a b by five examples. 

Example 1. Weighted i 2 Space 


□ 


Let H = £2 be the space of sequences in C with finite quadratic norm, i.e., H = £ 2 = 
{/ : No —* C : l/( n )| 2 < Let e k be the fc-th canonical element e k (n) = 8 k ,n- 

Then H s = {f : W 0 ^ C : EneNgl/( n )| 2 < °°}- For k = [h, k 2 ,..., k s \ G Mg, 
let e k [n) = Y\)=i e kj{ n j) f° r all n = [ni, n 2 ,.. ., n s \ G Mg. The inner product in H s 

is (f,g)H. = EfceNg f(. k ) 9 (k). Note that (e kl ,e k2 ) H . = S klM and EfceNg Mn)| 2 = 1 - 
Hence, H s is a reproducing kernel Hilbert space with kernel function 

K s (l, n) = 22 e k {l)e k (n) = Si >n for /, n e Mg. 

fcGNg 

For H s a bi we take m k = 1. Then r k = k and k(n) = n. The inner product of H s a b for 
./', Q G H s a b is given by 

= E f(k)g(k). 

fee N§ 

Hence / G H sab means that the |/(fc)| of / decrease exponentially fast. H sab is a 
reproducing kernel Hilbert space with kernel 

Ks, a ,b(l,n ) = 22 U} ^ =1 ajkjJe k(l)e k (n). 
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Example 2. Weighted Hermite Space 

Let p{x) = (27r) -1 / 2 exp(— x 2 /2) for all x G M be the Gaussian weight in the real line 
and let Her/; be the Hermite polynomial of degree k, 


Her fc (x) = 


l) k d fc 

' exp(x 2 /2) —j: exp(— x 2 /2) for all iel 


Vk\ 


Now we consider the Hilbert space of real functions which are Lebesgue square-integrable 
with respect to p and have an absolutely convergent Hermite series, i.e., 


H — < / : M — > M : / measurable, / \f(x)\ 2 p(x) dx < oo, 

Jr 

/(*) = Z fk Her fc (x) absolutely convergent | 
fce No 

with inner product (/,<?) = j R f(x)g(x)p(x)dx. Since it is known that {Her fc } fceNo is 
orthonormal, we can take e*, = Her^. Clearly, H is not a reproducing kernel Hilbert 
space. Then 


H s = \f-. 




: / measurable, / \f(x)[ 'p s (x)dx<oo, 

Jr s 

/(*) = Z /fcHer fc (aj) absolutely convergent > 




with 


Ps{x) = 


(2vr) s /2 


exp 


-5 ^ 

3 = 1 


for all x — [xi,x 2 , ■ ■ ■, x s ] G 


For k G Ng, we take ek(x) = Her fc (;c) = J^ =1 Her^/xj) for all x G M s . Then {e^}fc e pjg is 
an orthonormal basis of H s . Obviously, H s is not a reproducing kernel Hilbert space for 
any sGN. 

The weighted Hermite space H s a b is obtained by taking m*, = 1. Then r*, = k and 
k(n ) = n. The inner product of H sab for /, g G H sab is given by 


(f,9) 


h„ 


E 

kem 


u 




fk 9ki 


where fk and fjk denote the fcth Hermite coefficients of / and g , 

f k = (/, Her fc ) i2(KaiPs) = / /(as) Her fc (a;) p fl (aj) dx for all k G Ng. 

The weighted Hermite space H sab is a reproducing kernel Hilbert space due to Cramer’s 
bound which states that 


|Her fe (x)| < (2vr) 1/4 exp(x 2 /4) for all iGl and k G No, 
see m p. 324], Indeed, this bound leads to 

S OO S OO 

Z [e k ,a,b(x)} 2 = jjy u ajkb3 [Her k (xj)] 2 < JJ(2vr) 1/2 exp(x 2 /2) y u^ 3 < 00 
feeNg j= 1 fc=o j=i fc=o 
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since the series YlkLo^^ 3 < 00 f° r positive aj and bj. The reproducing kernel of 
H s ,a : b is 

K s ^ b (x, y) = y, u T.Ui a :>^ 3 Her fc (z:) Her k (y) for all x,y e M s . 

fcGNg 

More information on weighted Hermite spaces can be found in [HJ E] ■ HI 

Example 3. Weighted Korobov Space 

We now take H as the Hilbert space of complex-valued, square-integrable functions 
on [0,1] with absolutely convergent Fourier series, i.e., 

H — j/ : [0,1] — > C : / measurable, J \f(x)\ 2 da; < oo, 

f( x ) = fk exp(27rikx) absolutely convergent | 
fcez 

with inner product (/, g) = | 0 ' f(x)g(x ) da;. The orthonormal basis {efc}fceN 0 of H is taken 
as 

e 0 (x) = 1, e 2 fe-i(a;) = exp(27riA;a;), e 2k {x ) = exp(-27ri£;a;), 
for k E N with i = >f—l. Then 


H s = If : [0, l] s —» C : / measurable, / \f(x)\ 2 dx < oo, 

1 ' ' -Ao,i] s 

f( x ) = fk exp(2nikx) absolutely convergent 




and {e fc } feeN g with 

S 

e k(x) = P e kj (x 3 ) for all x 6 [0, l] s 

3 = 1 

as its orthonormal basis. Then / G H s iff 

/(*) = 5Z fh exp (27ri h ■ x) for all x 6 [0, l] s 

hez s 

with \fh\ 2 < oo, where h • x denotes the usual dot product. Here, Z is the set of 

all integers, Z :={..., —1, 0,1,... }, and 


fh = (f,e h ) L2 = f(x) exp(-2vri h ■ x) dx 

d[o,i] s 

is the hth Fourier coefficient. Clearly, H s is not a reproducing kernel Hilbert space for 
all s e N. 

The weighted Korobov space H sab is obtained by taking m 0 = 1 and mk = 2 for all 
k G N. Then ro = 0 and r k = 2k — 1 for all k G N. The inner product of H sa j, for 
f,g E H sab is given by 


if, 9) 


H s ,a,b 


u ^= iaj]hjlbj fh9h- 

h£Z s 
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The space H s a b is a reproducing kernel Hilbert space and its reproducing kernel is 


K s , a ,b(x, y)=Y 


T,U a A h i\ j 




exp(27ri h ■ (x — y)) for all x,yE[0,lf 


heZ 3 


The weighted Korobov space H sa ,b is a space of periodic functions with period 1 for each 
variable. More information on these spaces can be found in [2 13] [TO, II]- □ 

Example 4. Weighted Cosine Space 

We take H as the Hilbert space of real-valued and square integrable functions defined 
on [0,1] with absolutely convergent cosine series, more precisely, 

H = j/ : [0,1] —>■ M : / measurable, J \f(x)\ 2 dx < oo, 

/ 0) = fo + E fkV2cos(7rkx) absolutely convergent| 
he N 

The orthonormal basis {efc}fc S N 0 of H is then taken as 

eo(x ) = 1, and ek{x) = V2 cos(nkx) for k G N. 

Then we take, as in the previous examples, H s = H (& ■ ■ ■ ® H and {efc}fc<=Ng with 

S 

ek(x) = e kj (xj) for all x G [0, 1} S 
j =i 

as its orthonormal basis. For h = [hi, h- 2 ,..., h s \ G Nq we denote by |h|o the number of 
indices j G {1,2,..., s} for which hj ^ 0. Then / G H s iff 

f(x) = Y JhY 2) |h| ° ( JJcos]^^) ] for all x G [0, l] s 


hew n 


\j =i 


with ^2 hem \fh\ 2 < oo. Here 


fh = (f,e h ) L2 = I f(x)(V2) lhl ° (ncos]^) ) da? 

J [o,H s \J=i J 

is the hth cosine coefficient. Clearly, H s is not a reproducing kernel Hilbert space for 
all sGN. 

The weighted cosine space H s a b is obtained by taking nik = 1. Then r k = k and 
k(n ) = n. The inner product of H s a b for /, g G H s a b is given by 




E 




U! ^ 


fh Qh- 


The space H s a 5 is a reproducing kernel Hilbert space and its reproducing kernel is 
K s ,a,b(x, y) = Y ^ Sj=iajlhjl J 2 |h,| ° | cos (7 ThjXj) cos (nhji/j) J for all x,y G [ 0 , l] s . 

he Ng \j= 1 / 

More information on cosine spaces with finite smoothness can be found in [4j. □ 


12 


Example 5. Weighted Walsh Space 


Let us denote by wah the fcth Walsh function in some fixed integer base b > 2, see for 
example [ 6 j Appendix A] for further details. 

We now study the Hilbert space of complex-valued, square-integrable functions on 
[0,1] with absolutely convergent Walsh series, i.e., 

H — j/ : [ 0 , 1 ] —> C : / measurable, J \f(x)\ 2 da; < oo, 

f( x ) = X fkwalk(x) absolutely convergent 
fce N 0 

For this example the orthonormal basis {efc}fc € N 0 of H is taken as 


e k (x) = wal k (x) for all k G N 0 . 


Then H s = L 2 ([0, l] s ) 

H s = j/ : [0, l] s —» R : / measurable, / \f(x)\ 2 dx < oo, 

qo,i] s 


/(*) = X /fewalfc(x) absolutely convergent i. 




and {e k } keN s with 


e k (x) = Y^e-k^Xj) = wal fc (x) := wal fc . (xj) for all x 6 [ 0 , 1 ]' 
j =i j =i 


as its orthonormal basis. Then / G H s iff 

f(x) = X /h,™iwal h (®) for all x e [ 0 , l] s 

he Ng 

with SheNg l/Xai | 2 < oo. Here, 

fh,w a \ = (/, walh ) L2 = / f (x) wal/ l (a;) da? 

a[o,i] s 

is the hth Walsh coefficient. 

The weighted Walsh space H sa b is obtained by taking rrik = 1. Then r k = k and 
k(n ) = n. The inner product of H SCL) 5 for /, g G H sa b is given by 

1 9^)H sab = X 3 fh,wa.ldh,wal- 

he Ng 


The space H S)a b is a reproducing kernel Hilbert space and its reproducing kernel is 
K s , a ,b(x, y) = X wal h (®) wal h (y) for all x,y e [ 0 , l] s . 

/iGNq 

More information on the Walsh spaces with finite smoothness can be found in [5], ;Bj. □ 
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3 Multivariate Approximation 


By multivariate approximation we mean an embedding operator APIA : H sab —> H s 
given by 

APP J = f for all / G H Sia b . 

Due to ([ 6 ]) , the operator APP S is well defined, and it is a continuous linear operator. 
Furthermore, ||APP s /||^ s < ||/||ff sab for all / G H s>a>b and 


||APP S || = 1 for all s G N. 


We will later show that APP S is a compact operator. 

We want to approximate APP s f by algorithms A n : H sab —> H s that use at most n 
continuous linear functionals of /. Without loss of generality, see e.g. mug , we may 
restrict ourselves to linear algorithms of the form 

n 

A n f = Y L i(f) 9j fo r all / G iP s , a , 6 

3 =1 

for some Lj G H* a b and gj G H s for j — 1, 2,..., n. 

We consider the worst case setting in which the error of A n is defined as 


e(A n ) = sup ||APPJ - = ||APP S - A n \\. 

Il/K a ,^ 1 

For n = 0, we have the so-called initial error which is achieved by the zero algorithm 
A 0 = 0, and e(A 0 ) = ||APP S || = 1. 

By the nth minimal (worst case) error we mean the minimal error among all algo¬ 
rithms A n , 

e(n, APP S ) = inf e(A n ). 

A n 

Clearly, e(0, APP S ) = 1. In a moment an algorithm A* for which the infimum is attained 
will be presented. 

By the information complexity n(e, APP S ) we mean the minimal n for which we can 
find an algorithm A n with error at most £ G (0, oo), 

n(e,APP s ) = min{ n : e(n,APP s ) < e}. 

Clearly, n(e, APP S ) = 0 for all e > 1, and therefore the only e’s of interest are from (0,1). 

It is well known, see again e.g., [meg, that the nth minimal errors e(n,APP s ) and 
the information complexity n(e, APP S ) depend on the eigenvalues of the continuous and 
linear operator W s = APP*APP S : H s ab -A- H s ab . The operator W s is self-adjoint and 
in a moment we shall see that W s is also compact. Let (A^j, r/ 5J ) be the eigenpairs of kF s , 

W s r] sJ = X s .j rjsj for all j G N, 

where the eigenvalues A s j are ordered, 

A<;,i ^ A Sj 2 > • • • > 0, 
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for all ii, .72 G N. 


and the eigenelements rj s j are orthonormal, 

{Vs,jl, Vs,j 2 ) H sta b ~ ^31,32 
Then the nth minimal error is attained for the algorithm 

n 

A nf = T}s ^ H s ^ b Vs,3 for a]1 / e H s,a,b, 

3 =1 


and 

e(n, APP S ) = e{A* n ) = sjX s , n +i for all n E N 0 . 

This implies that the information complexity is equal to 

n(s, APP S ) = min{ n E N 0 : X s , n +i < £ 2 }• (10) 

We now find the eigenpairs of W s . Using the notation and results of the previous 
section, we know that {e n)a) b} ne pjg is an orthonormal basis of H sab . We prove that 

W s e n , a , b = u£U Cn a b for a]1 n e 


Indeed, for f,gE H sab we have 

(APP S /,APP> 9 } H . = {/,APP;APP, 9 ) H ^ t = (f,W,g) H ^ b . 
Taking / = e ni>a> & and g = e n2?aj b for arbitrary n 1? n 2 E Nq we obtain from 


(^ni,a,6? ^^s&ri2,ci,b)}{ , (&ni,a,bi ^ri2,a,b)j 


n 

\j= 1 


0J a j [k((n 1 )j)} b 3 /2 [fc((n 2 ) 3 )]b/2 


( e nn e n 2 ) 




Hence, 

and 

This means that 


— w Ej=i % [fc((ni) 3 )]b/2+a i [fc((n 2 ) J )]b'/2 £ 

(e m , a ,6, W s e n2i0> i,) H)i a b = 0 for all n x ^ n 2 , 

(■e n ,a,b , W^,*,*)* = . 

’ ’ 7 5' 11 s,a,b 


ni,n 2 • 


^ ^ (Ws6 n a,6, &ni,a,b) a b &ni,a,b 1 J ^ ^ J ^ &n,a,b, 

niGNg 

as claimed. Hence, 




■ a ,6 


neNS 


are the eigenpairs of W s . 

As an example consider the weighted Hermite space or the weighted cosine space for 
which mk = 1. Then k{rij) = rij and the eigenpairs are of the form 


.uiu'tu' 2 , 


nGNg 
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For the weighted Korobov space, we have m o = 1 and m k = 2 for all k £ N. Then 
k(rij) = \rij/2\ and the eigenpairs are of the form 

(uZUi a > ffl bj ; w E5=i % K/21 b /2 e \ 

V ’ / riGNg 

We turn to the general case. The eigenvalues of W s may be multiple. Indeed, for 
rij £ N 0 we obtain the same k(nj ) for all rij £ {r k ( nj ), r fc ( n p + 1 ,... ,r fc ( n p +1 - 1 }, i.e., for 
r 'fc(n ) )+i — r k(nj) — m k(nj) different values of rij. This means that W s has the eigenvalues 

i ajk i of multiplicity m k := ■ ■ ■ mi g , 

zeZ3 fe 

where B k = {l £ Nq : Xp=i a j^j = J2)=i a j^ b /}- I n particular, the largest eigenvalue 
A, s i = 1 , obtained for kj — 0 for all j — 1, 2 ,..., s, has multiplicity m s 0 . So for m o = 1 the 
largest eigenvalue is single. 

Clearly, the sequence of ordered eigenvalues {A, sj } jG n is the same as the sequence 
{cu^=i a #K')l J } TlGN g. Furthermore it is obvious that linq^oo X S J = 0, which implies that 
APP S as well as W s are compact. 

We now find a more convenient formula for the information complexity n(£,APP s ). 
From ([HID we conclude that for £ £ (0, oo) we have 

n(£, APP S ) = |{ j £ N 0 : A Sj j > £ 2 } |, 


or equivalently 

n(£,APP s ) = \{j £ N 0 : log A“j < log £~ 2 }|. 

All eigenvalues A SJ - are of the form U3^= iaj ^ with multiplicity m k for k £ Nq. Therefore 


and 


Let 


Then 


log UJ 




) lo S w 1 

d=i 


log UJ £5=1°^/ < log £ 2 iff J2 a J k J < ^ £ 

3 = 1 


log UJ 


-1 


A(e,s) = < k £ Nq : ^ djk b ? < 


log £ 


-2 


3=1 


log UJ 


-1 


n[ 


i(e, APP s ) = ^ m kl m k2 ■ ■ ■ m ks . (11) 

k£A(e,s) 

Note that for m k = 1, as e.g. for the weighted Hermite space and the weighted cosine 
space, we have 

n(£, APP S ) = |A(£,s)|. 

For the general case, the set A(£, s) is empty for e > 1, and then n(£,APP s ) = 0 as 
we already remarked. Let 


log f ^ 

x[t ) = ———— for all t £ ( 0 , oo). 

log uj 1 


( 12 ) 
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For s — 1, it is easy to check that A(e, 1) = {0,1,..., \{x{e)/a\) l ^ bl ^ — 1} and 


n(e, APPi) = m 0 + mi + • • • + m r(a . (e)/ai) i/^^. 


( 13 ) 


For s > 2, we have 


S —1 


A(e,s) = |J < fc 6 Nq 1 x {k} : ^y aj< x(e) — a s k b 
k =0 l j =1 

r ( x ( £ )/ “s) 1 / 6 ®!—i 


s—1 


u 

fc =0 


fc G Nq 1 x {/c} : djk b j J < x(e) — a s k b 

3 = 1 


Since x(e) — a s fc 6s = (log (etc askbs ! 2 ) 2 )/log to x , we obtain from m 

r(*(e)/a,) 1/ *.-|_l 

n(e, APP S ) = ^ m fc n (e oj~ askbs / 2 } APP S _^ . 

k=0 


(14) 


For £i < e 2 we have n(£ 2 ,APP s ) < n(fo, APP S ). Since £ < £u> a = kbs / 2 for all k e N 0 , we 
conclude that 


n(e, APP S ) < 


(*(e)/a.) 1 /fc »l-l 

jy m*. I n(e,APP s _!) for all s > 2. 


(15) 


/c=0 


We obtain a lower bound on n(e, APP S ) if we consider only the term k — 0 in (U4l) . Then 
n(e,APP s ) > mo n(e, APP s _i) for all s > 2. 

For e > u ; a A 2 we have 

n(e, APP S ) = mo n(e, APP s _i) for all s > 2 

since £uj~ askis / 2 > 1 for all positive k and the terms in (fT4l) for k > 0 are zero. 

For x(e) > a\, define 


j(e) = sup {j e N : x(e) > aj }. (16) 

Obviously, j (e) > 1. For lim j aj < oo (here and in the following we use the convention 
that we write linij instead of lim^oo), we have j(e) = oo for small e. On the other hand, 
if liirij aj = oo we can replace the supremum in the definition of j (e) by the maximum 
and j(e) is finite for all £ with x(e) > a\. However, j{e) tends to infinity as £ tends to 
zero. 

If j (e) is finite then 

n(e, APP S ) = m^ j(e ' n(e, APPj^) for all s > j(e). 

Indeed, for j e (j(e), s\ we have x(e) < aj and x(e) — ajk b:i < 0 for all k > 1. This 
implies that £cu~ ajk J ^ 2 > 1 for all k > 1, and the sum in (fT4l) reduces to one term for 
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k — 0. Hence, n(e, APP S ) = m 0 n(e, APP S _!) = • • • = m s 0 APP_,-( E )), as claimed. 

Therefore, if j{e) < oo and mo = 1 then n(e, APP S ) is independent of s for large s, and 


lim 


log n(e, APP S 


0. 


Recall that we assume that the sequence m = {m k }k£ n 0 °f multiplicities is bounded. 
That is, 

m max = max m k 
fcGN 

is well defined and m max < oo. We also set 


rn min = min m k . 

ke N 


Clearly, rn min > 1. 

We are ready to prove the following lemma. 

Lemma 1. 

Let x(e), j(e), m max and m min be defined as above. 

(i) For e G (0,1) we have 

n(e, APP S ) > m s 0 , 

whereas for e G (0,1) and x(e) < a± we have 

n(e, APP S ) = m,Q. 

(ii) For x(e) > aq + a 2 + • • • + a s we have 

77,(e,APP s ) > (m 0 + mi) s . 

(in) For x{e) > ai and £ G (0,1) we have 


min (s,j(e)) 

n(£, APP S ) < m s 0 (l + 

3=1 




m 0 


x(£)\ 

a 3 ) 


1 /bj 


(iv) For x(e) > a\, £ G (0,1), and arbitrary aj G [0,1] we have 


min (sj'(e)) 

n(E, APP S ) > wig jl + 

3 =1 


m n 


m 0 


x( fia - «,> n a. 


1 /bj 


k=j+l 


In particular, for oij = (j — 1 )/j we have 

min(s,j(e)) / 

n(£,XPP s )>m s 0 JJ 11 + 
3=1 V 


m„ 


m 0 


x(£)\ 

a jS ) 


1 /bj 


- 1 
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Proof. To prove (JTJ) , observe that for £ G (0,1) the set A(e, s) is nonempty since k = 
0 G A(e, s). Therefore (TTIT) yields n(£,APP s ) > mg. Furthermore, for x(e) < a\ the set 
A(e, s) = {0} and therefore n(e, APP S ) = mg, as claimed. 

To prove dnj), observe that all k G {0,1} S belong to the set A[e, s). Therefore 


n(e,APP s ) > ^ m kl m k2 ■ ■ -m ks = (m 0 + mi) s , 

fcl,fc2,...,fc s =0 


as claimed. 

To prove (Imj) . we hrst take s — 1. Then dim yields 

i/feT 


n(e, APPi) < rriQ+m^ 


^(g)V 

a\ J 


- 1 = m 0 1 


m„ 


mo 


x{e) 

a\ 


l/bi 


- 1 


as needed. For s > 2 we use dl5l) and obtain 


n(e, APP S ) < m 0 1 + 




m 0 


x(£)\ 

a s J 


1 /b a 


1 n(s, APP s _i). 


This implies that 


n(e, APP S ) < mg JJ ( 1 

3 = 1 


m T1 


m 0 


z(e) 


i/b' 


Note that for j{e) < s we have a:(e) < aj for all j G [j(e) + 1, s] and therefore 


1 + 


m ri 


m 0 


- 1 = 1 . 


This means that we can restrict the product to j up to j(e). This completes the proof of 


ni0. 


To prove (fry]), it is enough to prove that 


n(e, APP S ) > mg 1 


m r , 


3 = 1 


m 0 


x(e) 


(! - «j) n 


\ Vb' 


fc=j+i 




- 1 


since for j G {j{£), s] we have x(e) < aj and the corresponding factors are one. 
Take hrst s — 1. Then dT3l) yields 


n(e, APPi) > m 0 ^1 + 

> m 0 ( 1 + 


77U 


m 0 

^min 

m 0 


i/fei' 


x(£)\ 

ai y 


a - 1/ “' 

CL\ 


as needed. For s > 2, note that x(e) 


a s k bs > a s x(e) for all k G N for which 


k < 


x(e){l 


a* 


l/b s ~ 


- 1. 
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For such k we have ecu askbs / 2 < s as and therefore from (fT4j) we obtain 


r(*(e)(l-a.)/a a )V6.-|-i 

n(e, APP S ) > ^2 m k n(£ a % APP s _i) 


> m 0 1 + 


fc =0 

TUr, 


m 0 


x(e)(l - a s )\ L/b 


1 n^APP^). 


Since x(e as ) = a s x(e), the proof is completed by applying induction on s. For aj = 
(j — 1 )/j we have (1 — aj) - +1 a k — l/ s > which completes the proof. □ 


4 Exponential Convergence 

As in [2j ;3] (SI flO] . by exponential convergence (EXP) we mean that the nth minimal 
errors e(n, APP S ) are bounded by 

e(n, APP S ) < C a q^ M ^ Ps for all n e N, 

for some positive C S ,M S and p s with q G (0,1). The supremum of p s for which the last 
bound holds is denoted by p* and is called the exponent of EXP for the s-variate case. 
We also have the concept of uniform exponential convergence (UEXP) if we can take 
p s = p > 0 for all s G N. Then the supremum of such p is denoted by p* and is called the 
exponent of UEXP. 

We want to verify when EXP and UEXP hold for the approximation problem APP = 
{APP s } seN in terms of the varying parameters a = {a s } se pj and b = {fe s } seN , which define 
the domain spaces H s a b of APP S and satisfy (ED- 

Theorem 1. 

Consider the approximation problem APP = {APP s } sG pj with the embedding operators 
APP S : H s a b ->• H s . Then 

(i) EXP holds for arbitrary a and b with the exponent 

P*s = TT and 

• -t Uj 
j=i j 


(ii) UEXP holds iff a is arbitrary and b is such that 




< oo. 


j =1 3 


If B < oo then the exponent of UEXP is p* = 1 /B. 

Proof. From (Hill) and (jlvj) of Lemma |T| with a fixed s we conclude that there are positive 
numbers ci(s) and c 2 (s) such that 


Ci(s)[x(e:)]' B,i < n(e, APP S ) < c 2 (s) [x(e)] Bs for all e e (0,1). 


b s 
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Clearly, x(e) = ©(log e x ). Therefore 

n(e,APP s ) = 0 ([log e~ l \ Bs ) . 

From this it follows that we can find positive Cj(s ) for j = 3,4, 5, 6 such that 

c 3 (s) e - (n / C4(s))1/Ss < e(n, APP S ) < c 5 (s) e~^/ c ^ 1/Ba for all n e N, 

where e = exp(l). This proves EXP with p* = 1/B S , as claimed. 

We now turn to UEXP. Suppose that UEXP holds. Then e(n, APP S ) < C s g^ n / M ^ P . 
This implies that 

n(e, APP S ) = 0 ([log £ _1 ] 1/p ) . 

Thus, B s < 1/p for all s G N. Therefore B < 1/p < oo and p* < 1/B. On the other hand, 
if B < oo then we can set p s = 1/B and obtain UEXP. Hence, p* > 1/B , and therefore 
p* = 1/B. This completes the proof. □ 

We stress that EXP and UEXP hold for arbitrary sequences m of multiplicity and 
the only condition is on b for UEXP. This is true since the concepts of EXP and UEXP 
do not specify how C s and M s depend on s. In fact, in general, it is easy to see from 
Lemma [U that ci(s) and c 2 (s), as well as the other Cj(s), depend exponentially on s. It 
is especially clear if the multiplicity mo >2. If we wish to control the dependence on s 
and to control the exponential dependence on s then we need to study tractability which 
is the subject of the next section. 


5 Tractability 

Tractability studies how the information complexity depends on both e -1 and s. The 
key point is to characterize when this dependence is not exponential in (s 4l ,£ -42 ) or in 
(s* 1 , (1 + log for some positive t\ and f 2) and when this dependence is polynomial 

in (s,£ -1 ) or in (s, 1 + log £ -1 ). For t x — t 2 — 1, the survey of tractability results for 
general multivariate problems and for the pair (s,^ 1 ) can be found in [12| IS], 14] , and 
for more specific multivariate problems and the pair (s, 1 + log £ -1 ) in (2J [3J (8, TO] . 

We will cover a number of tractability notions and verify when they hold for the 
approximation problem APP = {APP s } se pj in terms of the parameters a, b , m and u. 
We will analyze the tractability notions starting from the weakest notions and continuing 
to the strongest notions. A table which gives an overview of the obtained tractability 
results is presented in Section |6j 


5.1 Standard Notions of Tractability 

By the standard notions of tractability we mean tractability notions with respect to the 
pair (s,£ -1 ). 


• (U, h )~Weak Tractability 


As in [18], we say that APP is (ti, f 2 )-weakly tractable (shortly (U,^ 2 )-WT) for 
positive t.\ and t 2 iff 


lim 

S +£ -1 —>00 


log n(e, APPg) 

S* 1 + £~ t2 


0 . 
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This means that n(e, APP S ) is not exponential in s tl and e~ t2 but it may be expo¬ 
nential in s ri or e~ T2 for positive T\ < t\ or T 2 < t 2 - In particular, if t\ > 1 we may 
have the exponential dependence on s which is called the curse of dimensionality. 

Theorem 2. 

APP is (ti, t 2 )-WT for the parameters a, b, m and oj iff t\ > 1 or mo = 1. 


Proof. Suppose that APP is (ti,t 2 )-WT for the parameters a,b,m and u>. Then 
for fixed £ G (0,1) we obtain from (GJ of Lemma [T] that 


0 


lim 

s—>• oo 


n(e, APPs) 

gtl -)- *2 


> lim 

s—too 


s log mo 
s * 1 + e~ t2 


lim s 1 fl log mo 

s—>• OO 


and hence we must have t\ > 1 or m 0 = 1. 

Suppose now that fy > 1. We first show that the hardest case of APP is for 
constant a and b, i.e., ay = ay and bj = b\. Indeed, the eigenvalues of W s , which 
define n(e, APP S ), are u £j=i \ Clearly, 


a A k ( n j)] bj 

3 = 1 


>^2ai[k( nj )} bo , 

3 = i 


where b 0 = infj bj. Due to ((3]) , we have b 0 > 0. Therefore 

u EJ=i "AKnpP < w E J s =i«ibK)] 6 0 ) 


and n(e, APP S ) is maximized for ay = ay and bj = b 0 (and just now b 0 = b\). 

Hence, it is enough to show (fy, t 2 )-WT for constant a and b. From (Imj) of Lemma Q] 
we have 

log n(e,APP.) < S (log mo + log (l + N £ "] 1/h )) • 

This shows that for small £ we have 


log n(e, APP S ) = 0(s log log £ *) (17) 

with the factor in the big O notation independent of s and e~ 1 . Hence, 

log n(e, APP S ) = / s log log £~* \ 

.S h + £ - * 2 \ S* 1 + £ - * 2 J ’ 


Let y = max(s tl ,£ 12 ). Then £ 1 < y 1 ^ 2 , s < y 1 ^ 1 and 

s log log £ —1 y 1 ^ 1 log log y 1 ^ 2 log log y 1 ^ 2 

S* 1 + £~ t2 ~ y y 1 - 1 /*! 

and it goes to zero as s + £ _1 , or equivalently y, approaches infinity since t\ > 1 and 
t 2 > 0. This proves (£i,£ 2 )-WT. 
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Finally, suppose that mo = 1. Then the second largest eigenvalue for all s is 
A 12 = cu ai , which is smaller than the largest eigenvalue A Sj i = 1. As above it suffices 
to consider APP for constant a and b, i.e. a,j = a\ and bj = b±. In this case, we 
can use an estimate for the information complexity which has been shown in pQ>, 
p. 611], and which states 


where 


Then we have 


a s (e) 


n(s,APP s ) < 


(s-a a (e))! 11 


| n{e x l\ APPi), 


a s (e) = min < s, 


logs 


-i 


logo; - 


- 1 


logn(e,APP s ) < log-- ——— 

(s - a s (£)) 


a s (e) 

^ log n(£ 1/j ', APPi). 
j =i 


(18) 


From with the assumption mo = 1 we obtain 

n(£ 1/j , APPi) < 1 + m max < 2 m max max fl, —- 

Note that 

\ 1//bl / 2 log e -1 \ < / 2 log £ _1 A 1 ^ bl 

ai ) \a>ij log w_1 / \®i 1°§ 1 / 

Assume that £ < co ai ^ 2 . Then the last right hand side is at least one and therefore 

logn(£ 1/j , APPi) < log ^2rn max j y log 

= C\ + C 2 log logs -1 , 

where C\ = log(2m max (^-) 1 / bl ) — ^-loglogcu^ 1 and C 2 = Hence we obtain 



a s (e) 

logn(e 1/j , APPi) 
3 = 1 


< a a (e)(Ci + C 2 logloge x ) 

< C 3 logs' 1 log log£ -1 


(19) 


with a suitable 6' 3 > 0. Hence we have 


lim sup 

— 1 —yCXD 


log n(e, APP S ) 
s h _)_ £-*2 


< lim sup 

S+£ _1 —>00 


lQg (s-a s (e))! 
S * 1 + £~ t2 


Since 


s! 

(s - a s (e))! 


(s - a s (e) + l)(s - a s (e) + 2) • • -s < s as(£) 
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we have 


log 7-~7WT - a *( £ ) log s = °( lo g e 1 log s )- ( 20 ) 

(s - a s (e))! 

As before, let y = max(s tl ,£ _t2 ). Since t\ > 0 and t 2 > 0 we have e _1 < y 1 ^ 2 , 
s < y 1 ^ 1 and 

log g" 1 log s [log y} 2 
s 41 + e~ t2 ~ tit 2 y 

goes to zero as s fl + £~ t2 , or equivalently y, approaches infinity. Hence 

lognfe, APP S ) logn(e, APP S ) 

hmsup -----= Inn -----= (J. 

£ _|_ £ — S 1 T £ 2 S+£ — !—>oo S 1 T £ 2 

□ 


• Weak and Uniform Weak Tractability 

Weak tractability (WT) corresponds to (fi,f 2 )-WT for t\ — t 2 — 1. Uniform weak 
tractability (UWT) holds iff we have (fi,t 2 )-WT for all t 1: t 2 e (0,1]. 

Theorem 3. 

APP is WT iff APP is UWT iff m 0 = 1. 

Proof. Since UWT implies WT, it is enough to show that WT implies mo = 1, and 
that mo = 1 implies UWT. Suppose then that APP is WT. From the previous proof 
we conclude that mo = 1. On the other hand, if mo = 1 then APP is not only UWT 
but it is quasi-polynomially tractable which is a stronger notion than UWT. This 
will be shown in a moment. □ 

• Quasi-Polynomial Tractability 

APP is quasi-polynomially tractable (QPT) iff there are positive numbers C and t 
such that 

n(e, APP S ) < C exp (t(l + log s)(l + log W 1 )) for all s G N, £ G (0,1). 

The inhmum of t satisfying the bound above is denoted by t*, and is called the 
exponent of QPT. Clearly, QPT implies UWT. 

Theorem 4. 

APP is QPT iff m 0 = 1. 

If mo = 1 then the exponent of QPT is t* < { ~ - r and the last bound becomes 

an equality for constant a and b. 

Proof. Suppose that APP is QPT. Then APP is UWT and mo = 1. 

We now show that m 0 = 1 implies QPT and t* < 2/(ai logo; -1 ). As before, 
it is enough to prove it for constant a and b. In this case H s a 5 is the tensor 
product of s copies of H al bl . Then the eigenvalues of W s are products of 

the eigenvalues {A fc } fceN of W h i.e., {A s , fc } fceN = {A fcl A fc2 • ■ • A fes } felifc2j ... )fcseN with the 
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ordered (distinct) eigenvalues A& = a ) ai<yk 1)bl for k E N. It is proved in [Tj that APP 
is QPT iff A 2 < Ai and decay A := sup{r : liin^ k r Xk = 0} > 0. If so then 


t* 


max 


( 2 2 
ydecay A log ^ 


In our case, Ai = 1 and A 2 = oP 1 so that the assumption A 2 < Ai holds. Furthermore 
linp. k r oo ai( ' k ~ l)bl = 0 for all r > 0, so that decay A = 00 . Hence, t* = 2/(ai log cu _1 ), 
as claimed. □ 


• Polynomial and Strong Polynomial Tractability 

APP is polynomially tractable (PT) iff there are positive C,p and q > 0 such that 

n(e, APP S ) <Cs q £~ p for all s e N, e <E (0,1). 

APP is strongly polynomially tractable (SPT) iff the last bound holds for q — 0. 
Then the inhmum of p in the bound above is denoted by p*, and is called the 
exponent of SPT. For simplicity, we assume that 

1 ■ 

a := inn -—— 

j->»o log j 


exists. 

Theorem 5. 

APP is SPT iff APP is PT iff 

m 0 = 1 and a > 0. 

If this is the case then the exponent of SPT is p* 


2 


a log uj 1 


Proof. We use m Theorem 5.2] which states necessary and sufficient conditions on 
PT and SPT in terms of the eigenvalues {A S; fc}fc G N °f hF s . For our problem we have 
A s> i = 1. Namely, APP is PT iff there are numbers q > 0 and r > 0 such that 


sup 

seN 



s q < OO, 


( 21 ) 


and it is SPT iff the last inequality holds with q = 0. Then the exponent p* of SPT 
is the inhmum of 2r for r satisfying (12T)) with q — 0. 

In our case, 


E a 

k =1 


s,k 


wn 

nGNg j=1 


U 


r O j [k(n ;j )} h J _ 





k =1 


Let b 0 = infj bj and C T = m max JfkLi u> Tai< ' kb ° Then b 0 > 0 and C T < 00 for all 
r > 0. Furthermore, 


miCU raA < J2 m ^ Taikbj 

k=1 


< m max u Ta i J2^ Taj(kbj ~ l) < C T u Ta P 

k=1 
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Therefore 


JJ(m 0 + rmuj Taj ) < JJ 
j =i i=i 

Let ou Taj = (j + l) _3 d. That is, 

a. 


E 


m 0 + y m k uj 

k =i 


.T a.: h i 


< (rn 0 + C T 

3 = 1 


o; 


(22) 


Xj = 


log (j + 1) 


r log u and lim xj = a r log oj . 


J^-OO 


Then 

S 

n 

3 = 1 


m 0 + — 


mi 


O' + l) a 


< 


n -o + e m k u 

i =i V fc=i 


r dj k b i 


i=i 


+ — 


C T 


(j + l) a 


Hence, (12T1) holds iff m 0 = 1 and lim jXj > 1. Indeed, m 0 = 
otherwise we have an exponential dependence on s. For mo = 1, 
Then 


1 is clear because 
let ft G {m 1; C T }. 



exp E log(l + P(J + 1)' 


o'=i 


Furthermore, 


EMi+jso'+ir*') 

3 = 1 


8 Ed + u 


o=i 


with the factors in the big 0 notation independent of s and j. 

Suppose that a = 0. Then liny Xj = 0 for all r. This means for all S G (0,1) there is 
an integer j(S, r) such that x 3 < 6 for all j > j(S, r), and +1) - ^ = ©(s 1 ” 5 ). 

Hence 



is exponential in s 1 5 . This means that (OTj) does not hold for any positive r and 
non-negative q. Hence, we do not have PT. 

Suppose now that a > 0. Then lim jXj > 1 for r > (a log a; -1 ) -1 . This implies that 


Ed +!)’ Xj as well as 

3 =1 



1/r 


is uniformly bounded in s. Hence, (l2T]i holds for q = 0 and we have SPT with the 
exponent p* < 2 /(a log a; -1 ). For r < (a log cu" 1 )” 1 , the series Y^ S j= i (j +1)is °f 
order at least log s and (I2T|) may hold only for q > 0. This contradicts SPT. Hence 
P* log in -1 ), which completes the proof. □ 
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5.2 New Notions of Tractability 

We now turn to new notions of tractability which correspond to the standard notions 
of tractability for the pair (s, 1 + log £ _1 ) instead of the pair (s,£ -1 ). To distinguish 
between the standard and new notions of tractability, we add the prefix EC (exponential 
convergence) when we consider the new notions. As before, we study the new notions 
of tractability for the approximation problem APP = {APPs}.^ for general parameters 
a , 6, m and oj. 

• EC-(£i,f 2 )-Weak Tractability 

We say that APP is EC-(H, t 2 )-WT iff 

log n(e, APP S ) 

lim -n-rrr = 0- 

s+e-i-Kx) S* 1 + [log £ -1 ]* 2 

Obviously, EC-(fi,f 2 )-WT implies (ti,t 2 )-WT. For ti — 1 and t 2 > 1, this notion 
was introduced and studied in [15] . 

Theorem 6. 

APP is EC-(£i, i 2 )-WT for the parameters a, b, m and oj iff t\> 1, ort 2 > 1 
and m 0 = 1. 


Proof. Suppose that APP is EC-(H, t 2 )-WT for the parameters a , 6, m and oj. Then 
for fixed £ G (0,1) we obtain from (G]) of Lemma [T| that 


0 


lim 

s—»• oo 


log n(s , AP P s ) 
s* 1 + [log£ _1 ] t2 


> lim 

s—»• OO 


s log m 0 
s* 1 + [log£ _1 ] i2 


lim s 1 log mo- 

s—> oo 


Hence, we conclude that 1 1 > 1 or that mo = 1. For t\ < 1 and mo = 1, it remains to 
show that t 2 > 1. As in |d5] p. 609] we find that for e s G (A^ S / 2 J +1 )/ 2 , aL s / 2 J/ 2 ) =: L s , 
where A := uj ai , we have n(e s , APP S ) > 2L S / 2 J. Then 


^ logw(£ s ,APP s ) > lim [s/2\ log 

Z stl + [iog^L 1 ]' 2 ~~ s ~>°° stl + AV2J+1 logA _i 


This can only hold if t 2 > 1. 

Suppose now that t\ > 1. From (fT71) we have for small e, 

log w(£, APP a ) = f s log log £~ 1 \ 

S h + [log £ _1 ] f2 ys* 1 + [log £ _1 ] t2 ) ' 

Let y = max(s tl , [log e~ l ] t2 ). Then 

s log log £ _1 y 1 ^ 1 log y 

s h + [log £ _1 ] t2 “ t 2 y 

Clearly, this goes to zero as s + £ -1 approaches infinity since t\ > 1 and t 2 > 0. 
Hence, we have EC-(H, ^ 2 )-WT, as claimed. 
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Suppose now that £2 > 1 and mo = 1. From the proof of Theorem El (TT 8 T 1 . (1191) and 

02DD we obtain 

log n(e, APP,,) < C log e _1 log s + C 3 log e^ 1 log log e^ 1 

with suitable constants C,C 3 > 0. Since t\ > 0 and t 2 > 1 and using the same 
argument for y = max(s tl , [log e -1 ]* 2 ) as above, it follows that 

logn(>,APP s ) 

lim t -n-rrr = 0 . 

s+e-i-kxo S * 1 + [log £ —1 ]* 2 

Hence, we have EC-(U, i 2 )-WT. This completes the proof. □ 

• EC-Weak and EC-Uniform Weak Tractability 

EC-weak tractability (EC-WT) corresponds to EC-(1,1)-WT. EC-uniform weak 
tractability (EC-UWT) means that EC-(H,f 2 )-WT holds for all ti,t 2 E (0,1]. 
Clearly, EC-WT implies WT, and EC-UWT implies UWT. 

Theorem 7. 

— APP is EC-WT iff mo = 1 and Hindoo Uj = oo 7 

— APP is EC-UWT iff mo = 1 and hin^oo = 00 . 

Proof. We hrst assume that EC-WT or EC-UWT holds. Since EC-WT implies WT 
and EC-UWT implies UWT, Theorem [3] implies that m 0 = 1. For ti,t 2 E (0,1], let 

_ log w(e,APP a ) 
s,tl,t2 s* 1 + [log e -1 ]* 2 

Let 5 > 0 and take x(e) = (1 + <5)(ai + • • • + a s ). Due to the definition (fT2j) of x(e) 
this means that 

log e 1 =-—-(1 + 5) (ai + a 2 + • • • + a s ). 

From (jn]) of Lemma |T] we have 

slog(l + mi) log 2 

s,tl,t2 ~ s * 1 + [log e -1 ]* 2 ~ s tl_1 + [ 1(1 + 5) log ca -1 ]* 2 ?/,,’ 

where 

(ai + a 2 -\ - V a s ) t2 (s a s ) t2 adf 

Vs ~ s “ s _ s 1 -* 2 ' 

Then lim s z S]tl t2 = 0 implies that lim s y s = 00 , which in turn implies that 

lim 3 = lim —= 00 . (23) 

s—yoo s ^ s —>00 g ^2 — 1 

If we have EC-WT then lim s z St 1,1 = 0 and liirij aj = 00 , as claimed. If we have 
EC-UWT then, in particular, lim s z Sjljt2 = 0 for all positive t 2 . Then (l28l) yields 
there is a number s* = s*(t 2 ) such that 

a s > s t2 _1 for all s > s*(t 2 ), 
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or equivalently 


log a s 1 -t 2 c n ^ 

-- > - lor all s > s (t 2). 

log s t 2 

Since t 2 can be arbitrarily close to zero this implies that 


lim 

5—^00 


logOs 
log s 


= 00, 


as claimed. 

We now prove that mo = 1 and linq aj = 00 imply EC-WT. For any positive 77 we 
compute the 77 powers of the eigenvalues A S) k of the operator W s . We have 


nXln < = II ( 1 + J2 mkUJ 

k =1 


77 aj k b i 


due to 


k =1 

Hence, 


3 = 1 


<na+o«), 

3 = 1 


nyi( i +c„u,«) I/ ’’ 

Ac. 77, < —- 


Then (TTOT) yields 


77 .(e, APP S ) < 


n; =1 (i + c>^; 

£ 2 V 


Since log(l + x) < x for positive x, we conclude 


log n(e, APP S ) < 2?7 log e 1 + C v 'y~' j uj' naj . 

3 =1 


Observe that linij aj 
fore 


00 implies lim jU 3 vaj = 0 and lim s u vaj /s 


lim sup 

S-)-£ 1 —^OO 


log n(e, APP S ) 
s + log £ _1 


< 277 . 


Since 77 can be arbitrarily small this proves that 


0. Tliere- 


lim 

S-|-£ 1 —^OO 


log n(e, APP S ) 
s + log £ —1 


0. 


Hence EC-WT holds. 

Finally, we prove that mo = 1 and lim s (log a s )/log s = 00 imply EC-UWT. For 
x(e) > ai, (HUD of Lemma H] yields 


to 

log n(e, APP S ) < ^log 
3 = 1 



Let 60 = inf j bj > 0 and 


ol — m max 


O] log cu 


-1 


1/bo 
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From the definition (TT2|i of x(e) we then have 

m m ^ < «[ lo § e _1 ] 1/6o 5 

and 

log n(e, APP S ) < j(e) log (l + a [log £ _1 ] 1/&0 ) = O (j(e) log log £ _1 ) . 

We now estimate j(e) using the assumption that linij(log a,j) / log j = oo. We know 
that for all positive r there is a number j T such that 

aj > j T for all j > j T . 


This implies that 


j(e) < max (j T - l,x(e:) 1/r ) = O ([log £ . 

Therefore 

log n(£,APP s ) = O ([log £^] 1//r log log £” 1 ) . 

We stress that the factors in the big O notation do not depend on s. Then for any 
positive ti,t 2 € (0,1] we take r > l/t 2 , and conclude 

log n(£, APP S ) 
hm —---- = 0. 

s+e-i-^-oo S 1 f [log £ 1 ] t2 

This proves EC-UWT, and completes the proof. □ 

If we compare Theorems [3] and [71 we see that the assumption mo = 1 is always 
needed. However, WT holds for all a = {dj}j & pj, whereas EC-WT requires that 
liirij cij = oo. Similarly, UWT holds for all a = {aj}jeN, whereas EC-UWT requires 
that linij(log a 3 )/ log j = oo. Hence, a /s may go to infinity arbitrarily slowly for 
EC-WT, whereas they must go to infinity faster than polynomially to get EC-UWT. 
It seems interesting that WT, UWT, EC-WT and EC-UWT do not depend on b, m 
(with mo = 1) and c o. 

• EC-Quasi-Polynomial Tractability 

APP is EC-QPT if there are positive C and t such that 

n(e, APP S ) < C exp (t (1 + log s)(l + log (1 + log £^ 1 ))) for all s e N, £ e (0,1). 

The infimum of t satisfying the bound above is denoted by t*, and is called the 
exponent of EC-QPT. Obviously, EC-QPT implies EC-WT. 

Observe that 

exp (t (1 + log s)(l + log (1 + log £ -1 ))) = [es] ^ 1+log( ' 1+log £ 

= [e(l + log £ -1 )] ^ 1+log s \ 

We will sometimes use these equivalent formulations to establish EC-QPT. 
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Theorem 8. 


APP is EC-QPT iff 


y '« 1,-1 

m 0 = 1, 5* := sup 

sgN 1 + log S 


S=1 b J ± u™ (! + lo S j) lo S + 


< oo, and a:=liminf 
j->°o 


> 0. 


If this holds then the exponent of EC-QPT satisfies 

t* e 




a 


a 


In particular, if a = oo then t* = B*. 


Proof. We first prove that EC-QPT implies the conditions on m 0 , B* and a. Since 
EC-QPT yields EC-WT, we have m 0 = 1. To prove that B* < oo, we relate 
EC-QPT to EXP. From 


n = n(s, APP S ) < C exp (t (1 + log s)(l + log (1 + log £ 1 ))) 


we conclude that 


e(n, APP S ) < e < e • exp 


/ 1 / n \ hd-Hog s)) 1 

V e \c) 


Due to Theorem m EXP holds with the exponent 1/B S = 1 / X^>=i fy 1 - Therefore 
l/(t(l + log s)) < 1 /B s and 


-< t for all s e N. 

1 + log s 

Hence, B* < oo and t > B*, as claimed. 

To prove that a > 0, we proceed similarly as for EC-WT and EC-UWT. That is, 
for a positive 5, we take 

x(e) = (1 + <5)(cii + • • • + a s ) < (1 + 5) sa s . 

Now (jn]) of Lemma Q] yields 

s log (1 + mi) < log n(e, APPQ < log C 

where 

1 + log (1 + log £ -1 )) < 1 + log 


+ f(l + log s) (1 + log (1 + log e )), 


1 , (1 + 5) logo; 1 

1 + -—- S CL t 


For large 5, this proves that 

t (1 + log s) log a s 


> log (1 + mi) + o(s). 

Hence, a > 0 and t > log(l + mi)/a, as claimed. 

We now prove that m 0 = 1, B* < oo and a > 0 imply EC-QPT. 
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From mo = 1 and Lemma Q] we have n(£,APP s ) = 1 for x(e) < ai, whereas for 
x(e) > ai, we have 


min 




n(£,APP s ) < | 1 + m. 


max 



min (s,j(e)) 


1 /bj 


From the definition (fl2|i of x(e), we get 

n(e, APP«) < (1 + C, f [e log e' 1 ] S 



(24) 


where 



min (sj(e)) 


2 


1/bj 


a,j e log a; -1 


Note that holds for all s G N and all e 6 (0,1) if we take j{e) = 0 for x{e) < (i\. 

We now use the assumption that a > 0. This means that for any <5 e (0, a) there is 
an integer j$ such that 

dj > exp ( —^—t ) for all j > j 5 . 

VI + log jJ 

This means that linij aj = oo, and this convergence is almost exponential in j. 

We turn to j(e) defined by ffTBp . Now j(e) goes to infinity as e approaches zero. For 
log x(e) > <5, i.e., for e < cu e / 2 , we have 


j(e) < ma x(j 5 ,J(e)), 


where J(e) is a solution of the nonlinear equation 

log x{e) _ J{e) 


(25) 


5 1 + log J(e) 


The solution is unique since the function y/( 1 + log y) is increasing for y > 1. 

Let a(e) = (log x{e))/8. Then we have from (125]) that J{e) = a(e)(l + log J(e)). 
Now we write J(e) in the form 


J(e) = (1 + /(e))a(e) loga(e), 


where f(e) is given by 

1 + log(l + log J(e)) 1 + 


Iog(l+log J(e)) 

log Jp) _ 1 


o(l) for £ —> 0. 


log a(e) 


log(l+log J(e)) 


Hence we have 


J{e) = (1 + o(l))a(e) loga(e) 


32 












(26) 


1 + °( X ) n /mi l°g x ( £ ) 

---[log x(e)] log--- 

1 + [log log £ _1 ] log log log e _1 . 


We turn to H241) . Note that linij aj = oo implies that only a finite number of factors 
in C S £ is larger than one. Therefore 


min (s,j(e)) 


C s .e < Cl := sup 


n 


sGN, eG( 0 , 1 ) JL, \ a je log u> 
Furthermore, from the assumption B* < oo we have 


1 /bj 


< oo. 


min(sj'(£)) Y^ mlnl 

E Jw 

3 =1 


minO j'F)) U -1 


(1 + log s) < B* (1 + log s). 


1 + log S 

Therefore we can rewrite (!2Tj) as 

n{e, APP,) < (1 + rn max ) min(sj(£)) C x [e (1 + log (1+log s) . 


(27) 


We now analyze the first factor /3 := (1 + ru max ) mm l s, A e )) in (|27]h Let s* G N and 
6 * G (0,1) be arbitrary. Note that for s < s* or for e G [e*, 1] we have 

P < (1 + m max ) max ^‘’^ £ ‘» =: C 2 < oo. 

Hence, without loss of generality we can consider 


s > s* and £ G (0, £*). 


We now choose s* such that s* > jg. For any positive rj G (0,1) we choose a positive 
e* such that for all £ G (0, £*) we have 


log log log £ 1 > 

8J(e) e 

log log £ —1 log log log e ” 1 

_ (1 + v) _ < 

s (-I I lug( i -Ij)/S - log big log log £ ■ \ “ 

V log log log e - 1 ) 


<5 

1 — 77 ’ 

(28) 

[ 1 - 77,1 + 77 ], 

(29) 

1 + 277 
<5 ' 

(30) 


Observe that such a positive e* exists since (128]) clearly holds for small e, whereas (J29]) 
holds due to (J2SJ), and (130]) holds since the limit of the left hand side, as £ —* 0 , is 
(1 + rj)/8 which is smaller than the right hand side. 

We are ready to estimate 


P = [e s] V3 ’ e = [e (1 + log £ 1 )] 2s,e , 


where 

_ min (s,j(e)) log (1 + m max ) 
Vs ’ £ log (es) 
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Zfi.F. - 


min(s, j(e)) log (1 + m n 
log (e (1 + log e- 1 )) 


We consider two cases depending on whether s or J(e) is larger. 

Case 1. Assume that s < J(e). 

Note that the function y/(l+log y) is an increasing function of y G [1, oo). Therefore 

s < J ( £ ) 

1 + log s _ 1 + log J{e)' 

(1 + rf) log log e~ l log log log e~ l 
5(1 + log ^J 1 + log log log £ _1 + log log log log £ _1 ) 

1 \ 2>1 log log 1 < 1 + x 2v (1 + log (1 + log £ -1 )). 


Due to (123|) and (j3U|) . 
J(£) 


1 + log J(e) 

Hence, 

Vs,e < 

< 

This yields 


< 


< 


log (1 + m max ) < 


J{£) 


1 + log s "° v ' l + logJ(e) 

(1 + 277 ) log(l + m max ) 


log (1 + m n 


(1 + log(l + log £ x )) 


P < [ es j<5 H1+2J?) log(l+m max ) (l+log (l+log e !)) 

which can be equivalently written as 
1 + 27 / 


[3 < exp 


log(l + m r 


(1 + log s)(l + log (1 + log £ )) 


This and (1Z7|) yield EC-QPT with t < B* + 5 _1 (1 + 2 rf) log (1 + m max ). Since 5 
can be arbitrarily close to a and 77 can be arbitrarily small, we conclude that the 
exponent of EC-QPT in this case satisfies 


t < B* + 


log (1 + m max ) 


a 


Case 2. Assume that s > -He). 

Then s > 5 _1 (1 — 77 ) [log log £ -1 ] log log log £~ l > log log £~ l due to (1281) and (j29j) . 
Hence, log s > log log log £ _1 . We now estimate z SjE . Assume that e > 0 is small 
enough such that j(e) < J(e). Then we have 


Zs,£ — 


< 


j{e) log (1 + m max ) J(e) log (1 + m max ) 


1 + log (1 + log £ _1 ) 1 + log (1 + log £ _1 ) 

(1 + 77 ) log (1 + m max ) log log £ —1 log log log £ —1 


1 + log (1 + log £” 1 ) 


< 


(1 + 77 ) log (1 + m n 


log log log £ 


-1 
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< (! + V) i°g(l + ”W) (1 + , Qg 3) 


Hence we have 
P < exp 


I + 77 

5 


log (1 + m n 


(1 + log s)(l + log(l + log e )) , 


and the rest of the proof goes like in Case 1. This completes the proof. 


□ 


We compare Theorems [4] and [HJ The assumption mo = 1 is needed for both QPT 
and EC-QPT. However, QPT holds for all a and b, whereas for EC-QPT we need 
to assume that B* < 00 and a > 0. This means that bj must go to infinity roughly 
at least like j, and aj must go to infinity almost exponentially fast. 

• EC-Polynomial and EC-Strong Polynomial Tractability 

APP is EC-PT iff there are positive C, p and q > 0 such that 

n(e, APP S ) < C s q (1 + log e~ l ) p for all s 6 N, e 6 (0,1). 

APP is EC-SPT if the last bound holds with q = 0, and then the infimum of p is 
denoted by p *, and is called the exponent of EC-SPT. 

Theorem 9. 

APP is EC-PT iff APP is EC-SPT iff 


lo^ CL 

rriQ = 1, B := y — < 00 and a* = lirninf - — > 0. 

^' a, 1—s-™ 

j =1 3 


3^00 j 

If these conditions hold then the exponent of EC-SPT satisfies 


s|c -— 

p e 


log(l + mi)\ log(l + m n 
max B, --- , B + - 


a ’ 


a* 


In particular, if a* = 00 then p* = B. 


Proof. We prove that EC-PT implies m 0 = 1, B < 00 and a* > 0, and then that 
mo = 1, B < 00 and a* > 0 imply EC-SPT and find bounds on the exponent of 
EC-SPT. 

EC-PT implies EC-WT and therefore m 0 = 1. It is easy to show that EC-PT 
implies UEXP. Indeed, the bound on EC-PT yields that 

e(n, APP S ) < e • e ~^~ 3 )/(Cs^ for aU n G 

Hence, UEXP holds and the exponent of UEXP is at least 1/p. Then Theorem Q] 
implies that B < 00, and p > B. 

To prove that a* > 0, we proceed similarly as for EC-WT. That is, for S > 0 we 
take x(e) = (1 + <5)(ai + • • - + a s ) and then flu]) of LemmaHJand the bound on EC-PT 
yield 

(1 + mi y < n(s, APP S ) <Cs q (l+ (1 + <5) 2 lQSa; \ ai + ■ ■ ■ + a s ) 
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Since a\ < ci 2 < • • •, this implies that 


SCL s ^ CL\ T • • • T CL S A 


2 

(1 + 5) log uj- 1 


/(l + mi) s \ 1/p 

V C8* J 


1 


Hence, 

* r • f lo S a * ^ Ml + mO 

a = Inn ml - > - > 0, 

s— >oo S p 

as claimed. This also shows that p > log(l + mi)/a*. 

This reasoning also holds for all p for which EC-SPT holds. Therefore the expo¬ 
nent p* of EC-SPT is at least p* > log(l + m\)/a*. Furthermore, p* cannot be 
smaller then the reciprocal of the exponent of UEXP, so that p* > B. This proves 
the lower bound on p*. 

We now assume that m 0 = 1, B < oo and a* > 0. Note that a* > 0 means that aj 
are exponentially large in j for large j. Indeed, for <5 G (0, a*) there is an integer 
such that 

a 3 > exp(Sj) for all j > j* 5 . 

This yields that for j{e) defined by (flfil) we have 

./ s . ( •* log z(e)\ 

]( e ) < max I j s , - - - 1 . 


For x(e) < a i, (El of Lemma |T] states that n(e,APP s ) = 1, whereas for x(e) > a 3 , 

(Jm| of Lemma |T] yields 


n(e,APP s ) < 


< 


< 



Since x{e) = ©(log e x ) we obtain EC-SPT with p < B + (log(l +m max ))/5. Taking 
6 arbitrarily close to a*, we obtain that the exponent of EC-SPT is at most 


* <B+ log(l + m max ) 
a* 


This completes the proof. 


□ 


We now compare Theorems l5l and ITOl for SPT and EC-SPT. In both cases, we have 
mo = 1. However, the conditions on a and b are quite different. SPT holds for all b , 
whereas for EC-SPT we must assume that B < oo, i.e., bj must go to infinity at 
least like j. The conditions on a are even more striking. SPT holds for aj going to 
infinity quite slowly like log j , whereas EC-SPT requires that aj goes exponentially 
fast to infinity with j. 
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6 Summary 

In the following table we summarize the tractability results. We tabulate the various 
notions of tractability with their corresponding “if and only if” conditions: 


Tractability notion 

iff-conditions 

(ti,t 2 y wt 

ti > 1 or m 0 = 1 

WT, UWT, QPT 

m 0 = 1 

PT, SPT 

m 0 = 1, and lim. ; 2L- > 0 

EC-(H,t 2 )-WT 

ti > 1, or t 2 > 1 and m 0 = 1 

EC-WT 

m 0 = 1, and liny,- clj = oo 

EC-UWT 

m 0 = 1, and liny,- = oo 

EC-QPT 

m 0 = 1, sup. < oo, and lim inf, —> 0 

EC-PT, EC-SPT 

m 0 = 1, , bj 1 < oo, and lim inf ? > 0 

z1 J J 3 
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